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PHASE 1: Exporting your animation using D’Fusion export tool 


Important: First Check that your D’Fusion HASP is plugged into your computer so as your web camera! 


1.1 

Create an empty folder for instance on your 
desktop: atome_scenario 

Go to MAYA 

Create an animated object, in my case, an atome 
Good Maya tutorials can be found at: 
http://www.swinburne.edu.au/design/tutorials/maya- 


video-tutorials.php 


When the atome is built, save it as atome.mb under 
atome_scenario folder 


1.2 Open D’Fusion Exporter 
(If Maya is corrected installed under your username, 
DFusion Export tab should appear besides the Help tab) 


Click on D’Fusion and choose Export 
No need to change the timeline name if it is only 
one animated object 
Click on Add hierarchy to select the object 
Choose the export folder you have just created 
(atome_scenario) 
Give a name, for instance atome_animation 
Click on Export, no need to click on Save! 
=> It creates a folder atome_animation 
containing three files xxx.mesh, 
xxx.material and atome_animation.scene 


1.3 OPTIONAL BUT STRONGLY RECOMMENDED 
Go to the folder atome_scenario, look for 
atome_scenario.scene and double click to see if it 
works in D’Fusion Viewer 

D’Fusion Viewer will automatically open after double- 
clicking 


Open the Windows tab in D’Fusion Viewer and 
check Animation. Then you probably need to zoom 
out to see the object (with the scroll button of your 
mouse) 


Choose timeline (see pic 3) 

Click on Play 

That will create a file ogre.log in 
atome_animation folder. 


There is a problem if you do not see the animation 
working. 

If so, go back to Maya and check again if the 
animation works there then export it again. 
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PHASE 2: Creating your working folders and scripts 


2.1 Create 3 folders under atome_scenario folder 
Names: tracking, medias and script 

2.1.1. tracking 

2.1.2. medias 

Drag the whole atome_animation folder ( 4 files: mesh, 
material, scene, and log) from the atome_scenario 
folder under the medias subfolder 

Drag also : atome.mb under medias 

You should have now 5 files under medias folder 
2.1.3. script 

Go to cube_scenario. This folder had been created by 
Total Immersion’s trainer during the training (May 
2010). 

Copy and paste global, tracking and 
cube_animation.lua files under atome_scenario/script 
folder 

Change the name of cube_animation into 
atome_animation 


Make the following changes in the file 
atome_animation.lua 

(Open it with Notepad for instance) 

2K 2K 2K 2 2k 26 2K 6 2K 2K 2 2 gk OK OK OK OK OK 6 OK OK OK OK KOK OK KK OK OK KOK OK KOK KK 
myAtome = Scenette(g_ Scene:getObjectByName("atome")) 
myAnimation = myAtome:getAnimation("timeline") 
myAnimation:setLoop(true) 

myAnimation:play(0) 

--my comment 

2K 2K 2K 2 2 6 2K 6 OK 2K 2K 2k 6 2 OK OK OK OK 6 OK 8 OK OK OK 6 OK KK OK OK KK OK KK KKK KKK 


and save it 


Open the file tracking.lua (using Notepad) 


change the line 
2K 2K 2K 2 2 2 2K 26 OK 2K OK 2 ok 2 OK OK OK OK KOK OK OK OK KK KK KK OK OK KK OK KOK KK KK KK 


local VideoCapture = VideoCapture(g_Scene:getObjectByName("videoCapture")) 
9K 2K 2K 2 oe 6 28 6 OK 2K OK 8 eK OK OK OB BOK 8 KK KK KK OR OR KK KK KKK KKK KKK 


INTO 


OB RR OR OB RR RR OB RR OB RR OK ROB KR OK KR OR KR OK KR KR KR KK KKK KKK 


local VideoCapture = VideoCapture(g_Scene:getObjectByName("videocapture")) 
2K 2K 2K 2 ok 6 28 6 OK 2K OK 2 oe OK OK OK OB BOK 8 KK KK KK OK OR KK KK KKK KKK KKK 


and Save it 


So that the letter C in the third word videoCapture becomes 
a small c > videocapture 
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name of your object 


igetObjectByName("atome’)) 
Animation("timeline") 


name coming from D'Fusion 
Exporter 


ystanc 
toe ok oe ok 


PHASE 3: Setting up the tracking with D’Fusion CV 


3.1 CV studio 

Open CV studio 

Change the video parameters if needed 
Choose 640-480, RGB24 for a web camera 
Choose interlaced 

Choose Horizontal-Vertical 

Click on Apply 

Your web camera should start running 
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3.2 Scenario Manager 


Choose carefully the picture that will be tracked (remember, you need a picture with contrast) 


Click on Scenario manager tab 
Create object 
Choose Plane Autoinit 


Define the size of the picture you wish to track precisely for instance Plane Size default: 10 x 10 
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Object keyframe | Face Autolnit| Pointing Detect » rig: 
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Model ——————— Plane Aut 
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Load Model Plane 

3D Object 
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Scale y z 


3.3 Keyframe 
Press Keyframe 


Place the picture in front of your web camera 


Choose Freeze (pic 13) 
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Create Import 


Remove Imnage 


Merticnt Ft Hortrontal Flip 


Rotnte 


3.4 Reset Pose 
You need to adjust the Wireframe. 


To do that, you can easily use the Reset Pose button (pic 14a) to have a perfect plane surface. So basically 
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Dispiay 


Unfreeze 


Autolnit Keyframe 
Painting Keyframe 
Vertical Flip Horizontal Filp 
Rotate 


you do not have to adjust the wireframe using the mouse buttons (pic 145). 


mouse left button: rotate the keyframe 
mouse middle button: zoom in or out 
mouse right button: pan the keyframe 


When the size of the object is well parametred, neither you have to use the mouse buttons to validate the 


corners (yellow and blue coloured buttons). 
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Keyframe Info 


Pos: X -0.22 Y 0.03 Z 40.00 
<0) Si, GUC BS Y 0.00 Z 0.00 


Reset Pose Display Axis 


Trackball Mode 


Trackball Speed 1.00 


Click on Create 


pic 14b 


Check Autoinit Keyframe, the software will process the tracking, it takes few seconds. 
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Create Import... Display 
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3.5 Tracking Manager 
OPTIONAL BUT INTERESTING TO SEE WHAT POINTS ARE BEING TRACKED 


Open Tracking Manager, you should be able to see the track by showing the picture in front of the web 
camera. 

You can also: 

Click on Interest Points tab and check Display Keyframe, you should be able to see the tracking points 
displayed. 
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cenario Manager| !ract Output Manager Target Tracking Interest Points | Correlation| Ke 


-Parameters 


VY Display Keyframe Interest Points 


Display Previous Frame Interest Pts 


Max Number 300 


Quality 4 


A beh, = 


3.6 Save your work 
Save in atome_scenario/tracking 


Do NOT change the names of the 3 files suggested to you 
tracker.xml 

CameraCalib.xml 

CameraConfig.xml 


TIP: 

The tracker.xml refers to the picture that has to be tracked. 

You may already have done this tracking process with some other pictures. The tracker.xml files are saved somewhere in your 
computer. 

It you may quickly want to change the picture that has to be tracked without going through the whole D’Fusion Studio CV process 
but just replacing the tracking xml by the one created with a previous process. 


PHASE 4: Carrying out the augmented reality experience with D’Fusion AR 


4.1 Open studio AR pic 18 

Create a new project 

Save next to other folders medias, tracking and script ee eee 
folders. 

Call it atome.dpd Recent files: 

Save C:\Documents and Settings\juser\Tyopoyta\Total Immersion\vasara_scenario\vas: 


C:\Documents and Settings\juser\Tydpoyta\atome scenario\atome.dpd 

C:\Documents and Settings\juser\Tvop6yta\ Total Immersion\atome scenario\ator 

C:\Documents and Settinc-'juser\Tyépéyta \Total Immersion\videoanimation\atom 
“reate a new projet Load an existing project Exit 


4.2 Open the tab Add pic 19 

Choose 2D elements videocapture udio 

name: videocapture Add Application Project ? 
Location: tracking folder/cameraconfig file 40 Heinen 

OK |e) 


Rendering > 

2D Elements> Videocapture 
Effects >» \Videotexture 
Script Texture 


videocapture Text2D 
scenette Overlay 


4.3 Open the tab Add pic 20 

Choose 2D elements videotexture 

OK it |Add Application Project ? 

Go to OUTLINER 3D Elements 

Right click and Edit properties videotexture Rendering > fe (SL 

Select videocapture 2D Elements idancantiire 

Set initial values Effects >  Videotexture | s“SOUrc 
Script Texture 
videocapture Text2D =:\Docu 
scenette Overlay 2:\Docu 

4.4 Viewport pic 21 

in OUTLINER | 

Select viewport Post-Render scrit 

Edit properties 

Scroll down, in background texture, sasqoud or 

Select videotexture | Background alpha 1.00 


Set initial values 


Background textur> videotexture 


Texture top 0.00 


Texture left 0.00 


4.5 Save your work 

Save as atome.dpd 

Same as the one already created by you at the beginning of 
the phase IV. 

In other words, replace the existing one. The computer should 
warn you, do you want to replace... answer YES 


pic 22 
4.6 Open the tab Add 
Choose 3D elements  Aopkcation Prot? 
Choose scenette SDEeMeNN — Empty 30 object 
Call it atome Rendering >» Module 
Location: look for atome_animation.scene file in 2D Elements 
medias folder Scenette 
OK Tacos — SSCETGLG 


videocapture scene_00 C:\Documen... 
scenette scene_00 C:\Documen... 


Bien rl = 


Set initial values 


4.7 Add the scripts 


In OUTLINER pic 23 
Outliner 

: Name Type reel) 
4.7.1 Add script viewport viewport scene_00 
name: global videotexture videotexture  scene_00 
i : F videocapture videocapture scene_00 
Location: look for the file global.lua in arene aieine — 
atome_scenario/script folder Soene_00 scene scene_00 
. tracking luascript scene_00 
The one you have copied from CUBE_SCENARIO F ooba ae eei00 
atome_animation _luascript scene_00 
. camera camera scene_00 
4.7.2 Add script atome scenette scene_00 
name: tracking Tracking_Position object3d scene_00 


Debug_tracking_info text2d scene_00 


Location: look for the file tracking.lua in 


atome_scenario script folder 
The one you have copied from CUBE_SCENARIO 


4.7.3 Open the Outliner 

Drag tracking and global under scene_00O 
Go to scene_00 and edit properties 

Set initial values 


4.7.4 Fly over the Global file with your mouse cursor 
Edit properties 

Choose priority to 1 

Set initial values 

pic 24 
4.7.5 Open the tab Add 


Appiication Project ? 
Choose 3D elements 


3D Elements> Empty 3D object 


Choose Empty 3 object Rendering > Module 
Name: Tracking Position (No other possibilities, the spike temic RE 
. nae e Effe 
name must be: Tracking Position Bee ”  scenette 
(mind the capital letters) pr Re eerste 2D, 
O K bcapture videocapture scene_00 C:\Documen..., 
scenette scene_00 C:\Documen... 


4.7.6 Go to Hierarchy manager 

Drag atome under the folder Tracking Position 

Edit properties 

Set initial values 

The values must be 0 for atome (check again is atome is 
well under Tracking Position) 

Set initial values 


4.7.7 Open the tab Add 

2D elements and choose text2D 

The name should be "Debug _ tracking info" (mind the 
capital letter in Debug) 


4.7.8 Add script 

Name: atome_animation 

Location: look for the file atome_animation.lua in 
atome_scenario/script folder 

The one you have copied from CUBE_SCENARIO and 
renamed atome_animation in PHASE 2 

Make sure you have changed the lines in 
atome_animation.lua as described in PHASE 2 

2 2K 2 6 2B OK 2 ko OK 6 OB OK OK OK OK OK KK OK OK BOK KOK KK KKK KK KKK 
myAtome = Scenette(g_Scene:getObjectByName("atome")) 
myAnimation = myAtome:getAnimation("timeline") 
myAnimation:setLoop(true) 

myAnimation:play(0) 


--my comment 
2 2 2 6 2B OK 2 2K OK 2 8 OK OK OK OK OK OK RK 6 OK OK OB OK KOK KK KR KOK KKK KK 


OK 

Drag atome_animation under scene_00 
Edit properties 

Set initial values 


4.7.9 LAST STEP! 

Go to File 

Save 

Check if the AR works by clicking on Play 
Place your picture in front of the web camera 


(see Troubleshooting if the tracking does not work) 
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Outliner 


Name 
viewport 
videotexture 
videocapture 
timeline 
scene_00 

t tracking 

sak |,0) 8y-)| 

atome_animation 


Type 
viewport 
videotexture 
videocapture 
timeiine 
scene 
juascript 
luascript 
juascript 
camera 
scenette 
object3d 
text2d 


camera 
atome 
Tracking_Position 
Debug_tracking_info 


pic 28 
Ty D'Fusion AR Studio 


Fie Edit Add 


Lua Editor 


Outliner 


Name 
viewport 


F\s)8) @-)06)1) 


viewport 


Project ? 


eS) ts) 


Project ? 
Le 


Videocapture 
Videotexture 


Texture 


Text2D 
Overlay 


level) 

scene_00 
scene_00 
scene_00 
scene_00 
scene_00 
scene_00 
scene_00 
scene_0O 
scene_00 
scene_00 
scene_00 
scene_00 


Project 


= 


? 


scene_00 


PHASE 5: Sharing with others 


5.1 Go to Total immersion folder located on your C disk /Program Files 
Open the folder Dfusion Ar 2 

Open the Deployement folder 

Copy the whole folder Player Test and paste it in atome_scenario folder 


Create a launcher.bat 


(if you do not know how to create a bat file, see Troubleshooting at the end of this tutorial) 


Command line 
oh KK 2K 6 OK ok 6 Oe OK OK OK OK OK OK OK OK OK OK OK KK OK KK KK KK KK 


DFusion@HomePlayerTest\DFusionHomePlayerTest.exe -f atome.dpd 
2K 2K 2K 2K 2k 6 28 6 OK 2K OK 2 8 ok OK OK OK OK KK KK OK OK OK KK KK KK 


IMPORTANT 
Launch bat. file at least once 
That should create a license file .lic, this is very important! 


Picture to be tracked 
If you have the picture in MS Word format, place the file in the atome_scenario, for instance tracker.docx 
If you do not have it digitally, scan the picture and place the digital file into the atome_scenario folder 


Zip the whole folder to send it to your partners or clients or give the address when your partners can find 
the zip file to download from. 


Your folder should contain 
pic 29 


Gal DFusion@HomePlayerTest 
Gal media 
(> 
| script 
De 
im) tracking 
Ee] D'Fusion@Home.lic 
Fe | iso03% 
&> MS-DOS-koment 
3] atome.dpd 
(@ ) eros on 


As the license has been created once, your partners or clients will not have to have the HASP plugged into 
their computer but they will not be able to change anything in the files otherwise the augmented reality 
will not work anymore. 
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TROUBLESHOOTING: What do | do if... 


1. Bat files 


How do | create a bat file? 
Open Notepad 
Copy the command line 


pic 30 


Tiedosto Muokkaa 


Muotoile Nayta 


Ohje 


DFusionG@HomeP layerTest\DFusionHomeP layerTest.exe -f atome.dpd 


Tallenna nimella 


<a 
Kohde: Tyopoyta v 
Be @ tyorcyt tahan command line 
> (Qomat tiedostot 
ie) 2 Oma tietokone 
Viimeisimmat  ©2Verkkoymparisto 
tiedostot (Q0PHI 
(©.mayaSwatches 
(3 (Qatome_scenario 
Tyépéyta | (Boku 
eas (Mouth 
——.—" |G Total Immersion 
@ =) code.txt 
. |=] grandes_lignes.txt 
Omattiedostot 2 Pikakuvake Tyépoyta 
(=) wikitxt 
gs tahan nimi ja tiedoston muoto eli .bat 
Oma tietokone 
Verkkoymparisto 
Tiedostonimi: launcher.bat 


Tallennusmuoto: Tekstitiedostot (*.txt) 


Koodaus: 


2. Two Tracking problems 


2.1 First possible tracking problem 

The tracking works if you start seeing the coordinates of the tracking in the tracking window. 

If you do not see the animated object, click on Pause then go back to Hierarchy Manager. 

Check again if atome is under Tracking Position 

Right click on atome, check if the values in local and Orientation are set to 0. 

If atome is not under Tracking Position, drag it, check again if the values in local and Orientation are set to 
O then set initial values on. 


Reload and Play it again 
If it works, Save your work. 


Lua Editor 


Object « ‘itor 


2.2 Second possible tracking problem 

You see the object but without animation 

Open D’Fusion AR Studio if not already opened. 
Load the file atome.dpd 

Go to Outliner 

Under Scene_00, choose atome_animation (pic 31) 
Right click and edit properties 


Verify if Enabled and Trigger are checked (pic 32) 

If they are not checked or only one of them, check them. 
Set initial values 

Reload 

Play 


and if it works, Save your work. 


pic 31 pic 32 


Outliner Object editor 


Select object atome_animation 


Name Type Module Resource 
viewport viewport scene_00 Type: luascript 

videotexture  videotexture  scene_00 Restore initial values Set initial values 
videocapture videocapture scene_00 : “4 Edit Object Name ... 

timeline timeline scene_00 Ownc scene_00 

scene_00 scene scene_00 Enabled v Priority 0 


tracking luascript scene_00 C:\Documen.., Trigger v Framerate 0.00 


global luascript scene_00 C:\Documen... Rees 


F - New Parameter Input String 
ea if 


Input 
camera camera scene_00 [ 
atome scenette scene_00 C:\Documen.., [ fT 


Tracking_Posi... object3d scene_00 


- Local 
Debug_tracki.. text2d —_scene_00 ————————s 


Open in Editor 


Questions can be directed to Georges Segura or Mikko Liukkonen 
firstname.secondname@salpaus.fi 


Product of Vireaali project for internal use only 


Copyright: Koulutuskeskus Salpaus 2010 
all rights reserved 


15 


